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Abstract 

Suppose a gambler starts with a fortune in (0, 1) and wishes to attain a fortune of 1 by 
making a sequence of bets. Assume that whenever the gambler stakes the amount s, the 
gambler's fortune increases by s with probability w and decreases by s with probability 1 — w, 
where w < 1/2. Dubins and Savage showed that the optimal strategy, which they called 
"bold play", is always to bet min{/, 1 — /}, where / is the gambler's current fortune. Here 
we consider the problem in which the gambler may stake no more than £ at one time. We 
show that the bold strategy of always betting mm{£, /, 1 — /} is not optimal if I is irrational, 
extending a result of Heath, Pruitt, and Suddcrth. 

1 Introduction and background 

Suppose a gambler starts with a fortune in (0, 1) and wishes to attain a fortune of 1 by making a 
sequence of bets. If the gambler's current fortune is /, then the gambler may stake any amount 
less than or equal to /. The gambler wins the amount of the stake with probability w and loses 
the stake with probability 1 — w. Following [H], we refer to this game as red-and-black. Clearly 
the gambler should never stake more than 1 — /, which is enough to ensure that the gambler will 
reach the goal if the bet is won. The strategy in which the gambler always stakes min{/, 1 — /} 
is called bold play. 

In [SJ, Dubins and Savage developed a general theory for gambling problems. For red-and- 
black, they showed that if < w < 1/2, which means that the game is subfair, then bold play 
is the optimal strategy, in the sense that it maximizes the probability that the gambler will 
eventually reach the goal. Their proof is also given in chapter 7 of |2j and chapter 24 of |10j . 
See for some computations comparing the probability that a gambler will reach the goal using 
bold play to the probability that a gambler will reach the goal using other strategies. 

This result has been extended in several ways. Dubins and Savage 8 also considered primitive 
casinos, in which the gambler loses the stake s with probability 1 — w and wins [(1 — r)/r]s with 
probability w, where < r < 1. Note that r = 1/2 is red-and-black. They showed that bold 
play is optimal when the game is subfair, which in this case means w < r. Chen U considered 
red-and-black with inflation, in which the goal is not to reach 1 but to reach (1 + a) n after n 
bets for some n. He showed that bold play is optimal when w < 1/2. A different extension is to 
incorporate a discount factor, so that the gambler receives a utility of /3 ra , where < f3 < 1, from 
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reaching 1 on the nth bet. Klugman |12| showed that bold play is optimal for subfair red-and- 
black with a discount factor. However, for some subfair primitive casinos, there exist discount 
factors for which bold play is not optimal (see [I] and [0]). See also ^Jj for a discussion of the 
optimality of bold play in some two-person games. 

Several authors have considered discrete versions of this problem in which the gambler's initial 
fortune and the amount of each bet must be integers and the gambler's goal is to attain a fortune 
of n. An extensive discussion of discrete gambling problems such as this can be found in |13j . 
Bold play remains optimal when w < 1/2. Ross |15| showed that the timid strategy of staking 
exactly 1 each time is optimal in the superfair case when w > 1/2. See also |16| for an analysis 
of the superfair case when the minimum bet is 2. Dubins [7j showed, however, that if the win 
probability is less than 1/2 but is allowed to depend on the gambler's fortune, then bold play 
need not be optimal. 

Another direction of work concerns gambling problems in which there is a limit to how much 
the gambler may bet. The simplest problem of this type involves red-and-black in which the 
gambler may bet no more than I E (0,1/2) at one time. In this case, we define bold play as 
the strategy in which the gambler whose current fortune is / always stakes min{£, /, 1 — /}. 
Wilkins ^S] showed that if w < 1/2 and £ = 1/n for some positive integer n > 3, then bold 
play maximizes the chance that the gambler will reach the goal. Chen [3| showed that bold play 
remains optimal when there is a discount factor in addition to a limit on the stake of 1/n. In |14j . 
the optimality of bold play in continuous-time gambling problems was established under rather 
general restrictions on the gambler. 

However, Heath, Pruitt, and Sudderth JJ| obtained an important negative result for discrete- 
time red-and-black. They showed that if the gambler can stake at most £, and if l/(n + 1) < 
£ < 1/n for some n > 3 or if I is irrational and 1/3 < I < 1/2, then there exists e > such 
that if < w < e, then bold play is not optimal. To see heuristically why this is true, suppose 
1/4 < £ < 1/3 and the gambler's initial fortune is / = 1/2 — 5, where 5 is small. If the gambler 
plays boldly and loses the first bet, then the gambler's fortune after one bet will be 1/2 — £ — 5. 
The gambler's fortune can at most double to 1 — 2£ — 25 after the second bet and therefore can 
be at most 1 — 25 after two more wins. However, if the gambler first stakes 1 — 5 and plays boldly 
thereafter, then even with an initial loss, the gambler can reach the goal by winning the next 
three bets. Consequently, for sufficiently small 5, first betting £ — 5 makes the gambler more 
likely to achieve the goal after winning three or fewer bets. As u> J. 0, the probability that the 
gambler can win four bets before going bankrupt gets very small relative to the probability that 
the gambler wins three bets. Therefore, first betting £ — 5 is a better strategy than bold play for 
sufficiently small w. 

The purpose of the present paper is to extend this result by showing that when £ is irrational, 
bold play fails to be optimal for all w < 1/2, not just for very small w. The case of rational £ 
remains open except when £ = 1/n for some n > 3. Note that when £ is rational and 1/3 < £ < 
1/2, it is not even known whether one can improve on bold play for very small w. 

To state our result more precisely, define the function s : [0, 1] — > [0, 1] by s(f) = min{^, /, 1 — 
/}. We think of s(f) as the bold stake for a gambler whose fortune is /. Denote by the 
gambler's fortune after k bets, when the gambler plays boldly. Note that (A^)£i is a Markov 
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chain whose transition probabilities are given by 

P(X k+1 = f + s(f)\X k = f)=w, (1.1) 
P(X k+1 = f-s(f)\X k = f) = l-w. (1.2) 

Define Q(f) = P(X k = 1 for some k\Xo = /), which is the probability that a gambler who starts 
with a fortune of / will eventually reach the goal. The following is our main result. 

Theorem 1.1. Suppose w < 1/2 and £ is irrational. Then, there exist f G (0, 1) and e G (0, s(f)) 
such that 

wQ(f + 8(f) - e) + (1 - w)Q(f - B (f) + e) > Q(f). (1.3) 

If a gambler begins with a fortune of / and stakes s(f) — e, then the gambler's fortune after one 
bet will be / + s(f) — e with probability w and / — s(f) + e with probability 1 — w. Consequently, 
the left-hand side of (|1.3|) is the probability that the gambler will eventually reach the goal using 
the strategy of first staking s(f) — e and playing boldly thereafter, while the right-hand side of 
Q1.3|) is the probability that the gambler will reach the goal using bold play. Therefore, (|1.3|) 
implies that the strategy of first staking s(f) — e and then playing boldly is superior to bold play, 
and hence bold play is not optimal. 

2 Proof of Theorem 11.11 

In this section, we prove Theorem 11.11 The key to the proof will be the following proposition. 
Here, and throughout the rest of the paper, all logarithms are assumed to be base 2. That is, we 
write logn instead of log 2 n. 

Proposition 2.1. Let S = {/ : P(X k = 1 - 1 for some k\X = /) > 0}. That is, S is the set of 
all f such that a gambler who starts with a fortune of f and plays boldly could have a fortune of 
exactly 1 — £ after a finite number of bets. 

1. Suppose f G S. Then there exists a constant C > such that if < e < £, then Q(f) — 
Q(f-e)>C(l-w)- l °^. 

2. Suppose f ^ S. For all C > 0, there exists 5 > such that if0<e<5, then Q(f) — Q(f — 
e) < C(l -w)- lo ^ e . 

3. If £ is irrational, then there exists f G (£, 1 — £) such that f — £ G S and f + £ G" S. 

Proposition 12. II implies that Q(f) — Q(f — e) is larger when / G S than when f £ S. In other 
words, the difference between a fortune of / and a fortune of / — e matters more to the gambler 
when / G S than when / ^ S. Part 3 of the proposition states that when £ is irrational, we can 
find / such that / — s(f) G S and / + s(f) G" S. We will show that if a gambler starts with a 
fortune slightly below /, then it is better to make slightly less than the bold stake so that the 
fortune will not fall below / — s(f) if the bet is lost. This will imply Theorem ll.il 

An important tool for the proof of Proposition 12.11 is a coupling construction in which we 
follow two gamblers simultaneously. We present this construction in subsection 2.1. We prove 
parts 1, 2, and 3 of Proposition l2~T1 in subsections 2.2, 2.3, and 2.4 respectively. Then in subsection 
2.5, we show how Theorem 11.11 follows from Proposition 12.11 
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2.1 A coupling construction 

Throughout this and the next two subsections, we consider two Markov chains (Xk)^L and 
(^fc)fc^o - ^ e define Xq = f\ and Yq = f 2 , where fi> f 2 - Both chains evolve with the transition 
probabilities given by (jl.lj) and (jl.2j) . Consequently, we can think of Xk as the fortune after k 
bets of a gambler whose initial fortune is f\, while Y k is the fortune after k bets of a gambler 
whose initial fortune is f 2 . 

We assume these sequences are coupled, so that both gamblers win and lose the same bets. 
To construct this coupling, we work with the probability space ($7, P) defined as follows. Let 
Q = {0, 1}°°, and denote sequences in by w = (uj\,uj 2 , • • •), so uj — > u>j is the ith coordinate 
function. Let J-q be the trivial er-field, and for positive integers k, let T k be the u-field generated 
by the first k coordinate functions. Let T = o(T\,T 2 , ■ • •) be the product cr-field. Let P be the 
product probability measure with the property that P{uii = 1) = w and P(o»j = 0) = 1 — w for 
all i. We then say that the two gamblers win the ith bet if Ui = 1 and lose the ith bet if cjj = 0. 
In particular, for k > 0, we define X k+ i(u>) = X k (u) + s(X k (uj)) and Y k+ i(u) = Y k (u) + s(Yk(tu)) 
if uj k +i = 1, and we define X k+1 (w) = X k (u) - s(X k (u)) and Y k+1 (u) = Y k {uj) - s(Y k (u)) if 
u k+ i = 0. 

We now make some remarks pertaining to this construction. 

1. Since s(f) = min{£, /, 1 — /}, we see that if / < g, then \s(g) — s(/)| < g — /■ Therefore, 
/ + s(f) < g + s(g) and / — s(f) < g — s(g). It then follows by induction and the 
construction of the sequences (X k )'ffi z0 and (lfc)^L ^ na * -^k > ^fc for all k. Likewise, the 
fact that \s(g) - s(f)\ < g — f implies that X k - Y k < 2 k (fi - f 2 ) for all k. 

2. The fact that X k > Yk for all k means that if Y k = 1 then X k = 1. Since Q(/i) = P(Xk = 
1 for some k) and Q{f%) = P(Yk = 1 for some k), it follows that Q(/i) > Q{f2)- That is, 
the function / i— > Q(/) is nondecreasing. 

3. Note that 

E[X k+1 \F k ] = w(X k + s(X k )) + (1 - w)(X fc - s(X k )) 
= X k + (2w - l)s(Xk) < X k , 

where the last inequality holds because w < 1/2. Therefore, (^fc)^ =0 ^ s a supermartingale 
with respect to (J 7 k)'kLo- ^ * ne same argument, (lfc)^ =0 is a supermartingale with respect 
to (JF/j)^L . By the Martingale Convergence Theorem (see chapter 4 of 9 ), there exist 
random variables L\ and L 2 such that X k — > Li a.s. and Y/j — > L2 a.s. as — > 00. If 
< e < then s(f) > e for / G [e, 1 — e]. It follows that Li and L2 must be {0, l}-valued 
random variables. Furthermore, it is easy to see that Xk = 1 for sufficiently large k on 
{L\ = 1} and Y k = 1 for sufficiently large k on {L2 = 1}. Thus, Q(fi) = P{L\ = 1) and 
Q(/ 2 ) = P(L 2 = 1), from which it follows that Q(/i) - Q(/ 2 ) = = 1 and L 2 = 0). 

2.2 Proof of part 1 of Proposition I2.l1 

We begin with the following Lemma, in which we compute the gambler's probability of reaching 
the goal starting from a sequence of fortunes approaching 1. 

Lemma 2.2. For all n>0, we have Q(l - 1~ n t) = !-(!- w) n (l - Q(l - £)). 
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Proof. The statement is obvious when n = 0. Suppose the result holds for some n > 0. Since 
s(l — 2~( n+1 H) = 2~( n+1 * ) £, a gambler whose fortune is 1 — 2~^ a+l H will, after the next bet, have 
a fortune of 1 with probability w and a fortune of 1 — 2~ n £ with probability 1 — w. Thus, by the 
Markov property, 

q(1 _ 2~( n+1 ^) = w + (1 - w)Q(l - 2~ n £) 

= w + (1 - - (1 - w;) n (l - Q(l - I))) 
= l-(l-w) n+1 (l-Q(l-e)). 

The lemma now follows by induction on n. □ 

Proof of part 1 of Proposition \2.1\ Let fi = f and f 2 = / — e, where < e < £ Since f E S, 
there exists a positive integer /c such that if £> denotes the event that X k = 1 — £ and Afc+i = 1, 
then P{B) > 0. Note that for < j < k, we have Xj + \ — Yj + \ > Xj — Yj unless either Xj > 1 — £ 
and Xj + \ = 1, or Yj < I and = 0. Therefore, if B occurs, then Y k < 1 — I — e and thus 
Yfc_i_i < 1 — e. Combining this observation with remarks 2 and 3 in subsection 12 .![ we get 

QU) - Q(f - e) = P{L X = 1 and L 2 = 0) > P(B)P(L 2 = 0|£) > P(B)(1 - Q(l - e)). 

Choose a nonnegative integer n such that 2~( n+1 ^£ < e < 2~ n £, which implies that n < log £— log e. 
By Lemma l2.2| 

Q(l - e) < Q(l - 2-(™ +1 )^) = 1 - (1 - w) n+1 (l - Q(l - *)) 

< 1 - (1 - W f+^~^{1 _ Q(l _ £)). 

Thus, Q{f) - Q(f - e) > C(l - w)- lo s% where C = P(5)(l - - Q(l - ^)). 



2.3 Proof of part 2 of Proposition 12 . 11 

Our next step is to prove part 2 of Proposition ^, 11 which gives an upper bound for Q(f) — Q(f — e) 
when f $l S. We will compare the sequences (Xk)^L and {Yk)^L when fi = f and f 2 = f — e. 
Although (Xfc — Yfc)j£L ^ s n °t a supermartingale, we will be able to construct a supermartingale 
by considering the differences between the gamblers' fortunes at a sequence of stopping times. 
It will then follow that the gamblers' fortunes stay close enough together for us to obtain the 
desired upper bound on Q(f) — Q(f — e) when / ^ S. 
Given / and /* such that </*</< 1, define 



i if / = f * 

(s(f) - s(f*))/(f - f*) otherwise. 



Note that -1 < h(f,f*) < 1 for all / and /*. If £ </*</< 1 - £, then s(/) = s(/*) = £, 
which means h(f, /*) = 0. If /* > £ and / > 1 - £, then h(f, /*) < 0. If /* < £ and / < 1 - £, 
then h(f,f*) > 0. Also, recall that u k = 1 if the gamblers win the &th bet, and = if the 
gamblers lose the kth bet. We have 

X (lA _ Y u a_S (l + h(X k (u>),Y k (u)))(X k (u)-Y k (u>)) if Wfc+ i = l f . 

J yfc +!^-i (l-h(X k (u),Y k (u))){X k (u;)-Y k (u)) if ^+i = 0. 
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Define 

W k = (1 - w )- lo ^k-Y k ) = ( Xk _ y fc )-iog(i-»). (2.2) 

By dZU, we have 

E[W k+1 \T k ] = w(l + h(X k ,Y k ))- lo ^-^W k + (1 - w)(l - h(X k ,Y k )r lo ^-^W k 

= g(h(X k ,Y k ))W k , (2.3) 

where 

g(x) = w{l + x )- l °sd-™) + (! _ w )(! _ x )- Ml-™) 
for -1 < x < 1. Note that 

5 '(x) = (-log(l - u>))(u>(l + x )- 1 °g(i-«')- 1 _ (i _ u,)(i _ x)- 1 ^ 1 -" 1 )- 1 ). 

Suppose < x < 1. Since < -log(l - w) < 1, we have (1 + x )- 1 °g( 1 -"')- 1 < i anc l (i _ 
a;)-iog(i-w)-i > 1. Therefore, 

g'(x) < (- log(l - w))(w - (1 - w)) < 0. 

Since g(0) = 1, it follows that < g(x) < 1 for x £ (0, 1]. 

We now introduce four lemmas that will help us to define a supermartingale. 

Lemma 2.3. Suppose 1 - 1 < f 2 < fx < 1. TTien E\W{\ = W . 

Proof. We have s(fi) = 1 — f\ and s(/2) = 1-/2- Therefore, h(f±, f 2 ) = —1- Since g(— 1) = 1, 
it follows from (JT31) that E[W 1 ]=W . □ 

Lemma 2.4. Suppose f 2 < /i < 1 — ^. Define a stopping time R as follows. If h(f\, f 2 ) > 1/2, 
de/me i? = 0. If h{hJ 2 ) < 1/2, then let R(u) = inf{j : = 1 or h(Xj(uj), Yj(u)) > 1/2}. Let 
L = [1 + (1 - 2^) //j . T/ien R < L and E[W R ] < W . 

Proof. Proceeding by contradiction, suppose R(uS) > L for some lo. Then the gamblers must lose 
the first L bets. However, by the definition of L, any gambler who starts with a fortune of at 
most 1 — £ and then loses L consecutive bets has a fortune of at most I. Therefore, there exists 
j < L such that < Xj < £. Since Xj > Yj, it follows that Yj < £, and thus s(Xj) = Xj and 
s(Yj) = Yj. However, this means that h(Xj,Yj) = 1, and thus R < j, a contradiction. Hence, 
R < L. 

For j < R, we have Yj < Xj < 1 — £, and therefore < h(Xj,Yj) < 1. Since g(x) < 1 for 
x € [0, 1], we have, with the aid of ()2.3j) . 

EiW^^Tj] = W jAR l {R < j} + E[W j+1 \Fj]l {R>j} 

= WW{«<, } + g(h{X j ,Y j ))W j l {R>j} < W jAR . 

Therefore, (Wj AR )j^ is a supermartingale with respect to (J 7 j)j^ =0 . Note that < Wj AR < 1 for 
all j, so the Optional Stopping Theorem (see chapter 4 of [5]) gives E[W R ] < Wq. □ 
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Lemma 2.5. Suppose /2 < fx < 1 — £■ Let 

T(u) = inf{j > 1 : Uj = 1 or h^Xj^u), > 1/2}. 

Lei L = [1 + (1 - 2£)/£J as in Lemma\E]\ Then T < L + 1 and £[W T ] < aW , w/iere 

a=l-(l- 5 (l/2))(l- U ;) 2L . 

Proof. Define the stopping time -R as in Lemma l2.4l Then T = R if and only if the gamblers win 
the -Rth bet; otherwise, T = R + 1. Clearly T < L + 1 by Lemma 12.41 Let j4 be the event that 
the gamblers win the Rth bet. Then 

E[W T ] = E[E[W t \Fr\] = E[W R 1 A + E[W R+1 \F R ]l A c]. 

By the strong Markov property and (|2.3|) . .E^W^+i |.Fr] = g(h(X R , Y R ))W R . If the gamblers lose 
the i?th bet, then h(X R ,Y R ) > 1/2. Therefore, since g is decreasing on [0, 1], 

E[W R+1 \F R ]l A c < g(l/2)W R l A °. 

Thus, 

E[W T ] < E[W R 1 A + g(l/2)W R l A c] = E[W R - (1 - g{l/2))W R l A c]. (2.4) 

If A c occurs, then the gamblers lose the first R bets, and h(Xj,Yj) < 1/2 for all j < R. If 
h(Xj,Yj) < 1/2 and the gamblers lose the (j + l)st bet, then X j+l - Y j+1 > (Xj - Yj)/2. Thus, 
on A c we have X R - Y R > 2- R {h - f 2 ) > 2- L {h - f 2 ). Thus, 

E[W R l A c] > E[{2- L {h - f 2 )r los{1 - w h Ao ] 

= 2 Llo ^ 1 - w ^W P{A c ) = P{A C ){1 - w) L W . (2.5) 

Since A c occurs whenever the gamblers lose the first L bets, we have P(A C ) > (1 - w) L . Thus, 
since 2£[Wfl] < Wq by Lemma l2.4| combining (|2,4[) and (j2.5j) gives 

E[W T ] < E[W R ] - (1 - 5(1/2))(1 - w) 2L W < (1 - (1 - 5 (1/2))(1 - w) 2L )W = aW , 

which completes the proof. □ 

Lemma 2.6. Suppose f 2 < 1 — £ and 1 — £ < fi <1 — 1/2. Define the stopping time T by 

T(uj) = i 1 = 1 

1 ; \ inf{j > 2 :u)j = 1 or h(Xj-.i(u),Yj-.i(u))) > 1/2} otherwise. 

Let N(u) = 1 - a if u x = 1, and let N(uj) = 1 if u x = 0. Then T < L + 2 and E[NW T ] < W . 

Proof. Let A be the event that that the gamblers win the first bet, which means u x = 1. We 
have 

E[NW T ] = E[E[NW T \Fi]] = E[(l - a)W x l A + E[W T \Fi]l A c]. 
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If the gamblers lose the first bet, then X\ = fi — = 2/i — 1 < 1 — £. Therefore, Lemma 12.51 
and the Markov property give T < L + 2 and E\Wt\Fi]Ia* < aWiU<=- Thus, 

E[NW T ] < E[(l - a)Wil A + aPFiUc] 

= w(l - a)[(l + h(hJ 2 )){h - / 2 )]-^(i-«) 

+ (1 - w)a[(l - M/i,/ 2 ))(/i - /a)]- 10 ^ 1 -^ 
= - a)(l + h(A, / 2 )) _log(1_w) + (1 - «;)a(l - /a))" 1 ^ 1 — )] W 
< - q)2- 1os ( 1 - w ) + (1 - w)a2- lo ^ 1 - w ^}W 

(l-a) + ajw < W , 

which completes the proof. □ 

By combining Lemmas 12 . 3| 12 . 5 1 and 12. 61 we can obtain Proposition [221 in which we construct 
the supermartingale needed to prove part 2 of Proposition 12.11 We first inductively define a 
sequence of stopping times (7fc)£L . Let To = 0. Given T k , we define T k+ \ according to the 
following rules: 

1. If Y Tk (oj) >l-£, then let T k+1 (u) = T k (u) + l. 

2. If X Tk (u) <l-£, let 

T k+1 {u) = mi{j > T k (uj) + 1 : Uj = 1 or ^(w),^-!^)) > 1/2}. 

3. Suppose Yr k (uj) < 1 — £ and 1 — £ < Xx k (uj) < 1 — 1/2. If ^T k (u))+\ = 1> meaning the 
gamblers win the (T k + l)st bet, then let T k+ \(uj) = T k (u) + 1. Otherwise, let T k+ i(u>) = 
mf{j > T k (uj) + 2 : Uj = 1 or h(Xj-.i(u), > 1/2}. 

4. If Y Tk < 1 - £ and X Tk > 1 - £/2, then let T k+1 = T k . 

Proposition 2.7. Define the sequence of stopping times (7fc)^ =0 as above. For k > 0, Zei 
-Sfc = #{j ^ {0, 1, • • • , k — 1} : X^. < 1 — £}, where #S denotes the cardinality of the set S. 
Let N k = 1 — a on the event that, for some j < T k , we have Yj—i < 1 — £ < Xj-\ and the 
gamblers win the jth bet. Otherwise, let N k = 1. Define Z k = a~ Bk N k WT k - Then (Z k )uL is a 
supermartingale with respect to the filtration {J : T k )' k ' = o- Furthermore, T k+ \ <T k + L + 2 for all 
k>0. 

Proof. Let Am be the event that Yp k > 1 — £, and let A 2 , k be the event that Xx k < I — £. Let 
^3,fc be the event that Yr k < 1 — £ and 1 — £ < Xx k < 1 — £/2. Let A^ k be the event that 
Yj> k < 1 — £ and Xx k > 1 — £/2. Note that for all k, exactly one of these four events occurs. We 
consider the four cases separately. 

First, suppose A\ k occurs. Then Xx k > 1 — £, so B k+ i = B k . Also, note that T k+ i = T k + 1 
and Yp k > 1 — £, so N k+ \ = N k . Therefore, by Lemma 12.31 and the strong Markov property, 

E[Z k+1 l Alk \T Tk ] = a - B *N k E[W Tk+1 \T Tk }l Al:k 
= a- Bk N k E[W Tk+1 \T Tk ]l Alik 

= a~ B *N k W Tk l Al , k =Z k l Alk . (2.6) 
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Next, suppose Ai, k occurs. Then Xx k < 1 — I, so B k+ \ = B k + 1. The gamblers lose bets 
Tfc + 1, . . . , Tfc + i — 1, so Xj < 1 — ^ for T k < j < T k+ \ — 1. Therefore, iVfc + i = iVfc. By Lemma 
12,51 and the strong Markov property, 

E[Z k+1 l A2k \T Tk ] = a~^ + ^N k E[W Tk+1 \T Tk ]l A ^ k 

< a-^^N k (aW Tk )l A ^ k = a^N k W Tk l A2k = Z k U 2k . (2.7) 

Suppose A% k occurs. Then Xx k > 1 — I, so B k+ i = B k . Since Xx k < 1, we have N k = 1. If 
the gamblers win the (T k + l)st bet, then N k+ i = 1 — a. Otherwise, Xx k +\ = Xx k — s(XT k ) = 
2Xx k — 1 < 1 — £ and the gamblers lose bets T k + 2, . . . , T k+ \ — 1, so N k+ \ = 1. By Lemma 12.61 
and the strong Markov property, 

E[Z k+1 l A3ik \F Tk ) = a- B *E[N k+1 W Tk+1 \F Tk ]l A3 , k < a~ B *W Tk l A3k = Z k \ Mk . (2.8) 

Finally, if A^ k occurs, then T k+ \ = T k . Therefore, N k+ \ = N k and Wx k+1 = Wx k - Since 
Xr k > 1 — £, we also have B k+ i = B k and thus Z k+ i = Z k . Therefore, E[Z k+1 l A ^ JJ^rJ = 
Z k l Aik . This fact, combined with equations (|2.6|) . ()2.7|) . and H2.8|) . gives EyZk+i^Ti,} < ^fc- 
Hence, {Z k ) k X) = Q is a super martingale with respect to the filtration (^ r T fe )fc? = o- 

To complete the proof, note that clearly T k+ \ < T k + L + 2 if or ^4^^ occurs. The strong 
Markov property combined with Lemmas 12.51 and 12.61 implies that T k+ \ <T k + L + 2\l A2 yk or 
^.3^ occurs. □ 



We now use Proposition 12.71 to establish an upper bound on Q(f) — Q(f — e) when / ^ S. 
We will need one more lemma. 

Lemma 2.8. Fix f ^ S, and let N be a positive integer. Then there exists a positive integer 
M and a positive real number 5 such that if fa = f and fa = f — e where < e < 5, then the 
following hold: 

1. IfX k > 1 - £ and Y k < 1 - I, then k > M(L + 2), where L = [1 + (1 - 2£)/£\ . 

2. Let D k = #{j 6 {0, 1, . . . , k - 1} : X Tj < 1 - I or X Tj = 1}. Then D M > N. 

Proof. Let R k be the set of all possible values of X k , and let R k = Uj=o-^j- Note that R k is 
a finite set because there are only 2 k possible outcomes for the first k bets. For all g € [0,1), 
let v (g) be the number of consecutive bets that a gambler whose fortune is g must lose for the 
fortune to drop below 1 — I. That is, v(g) = when < g < 1 — £ and, for positive integers 
k, v{g) = k when 1 - 2~ k+1 £ < g < 1 - 2~ k £. Let V k = m&x{v(g) : g € R k }. Let M = 0. 
For i > 0, let M m = M { + V M .( L+2 ) + 1. Let M = M N . Choose 9 > small enough that 
Rm(l+2) n (1 - £, 1 - l + 0) = 0. Let 5 = 2- M{ - L+2 ">6. We will show that the two conditions of 
the lemma are satisfied for these choices of M and 5. 

Suppose k < M(L+2). If X k > l-£, then X k > 1-1+9, since / g S and R' k n(l-£, l-£+9) = 
0. By the first remark in subsection 12. H we have X k — Y k < 2 k e < 2 M ( L+2 ^5 = 9. Therefore, 
Y k > 1 — £. This proves the first part of the lemma. 

To prove the second part, we claim that for i = 0, 1, . . . , N — 1, we have 

D Mi+v MdL+2) +l > D Mi + 1. (2.9) 
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To see how (|'2.9|) implies the second part of the lemma, first note that Dm = Dq = 0. Suppose 
D Mi > i for some i > 0. Then % +1 = D Ml +v M . (L+2) +i > % + 1 > i + 1 by (|23|l. Hence, by 
induction, (|2.9|) implies that Dm > N. Thus, we need only to prove IJ2.9JI . First, suppose either 
Xt m . < 1 — £ or Xt m _ = 1. Then -Da^+i = Dm 4 + 1. Since (Di)?l is a nonincreasing sequence 
and Vm^l+2) > 0, we have (|2.9jl . 

Thus, it remains only to prove (|2.9|) when 1 — £ < Xt m . < 1- Write t> for v(Xt m . )• Note that 
v < Vr M . , and T Mi < Mj(L + 2) by Proposition O Therefore 

T Ml + « < T Mi + F TMj < Mi(L + 2) + F Mi (L+2) 

< + Vi^ l(£+2) )(i + 2) < M(L + 2). (2.10) 

We now consider two cases. First, suppose the gamblers lose the bets + 1, • • • , Tjifj + v - Then 
Xj > 1 — I for Xjvfi < j < TMi+v-i arid Xt m .+ v < 1 — £■ Also, by (|2.10|) and the first part 
of the lemma, we have Yj > 1 — £ for Tu t < J < Tm^v-i- Therefore, by the definition of the 
sequence (Tj)!^L , we have Tui+k = + for 1 < k < v. It follows that Xt m _ +v < 1 — £, 
which means D Mi +v+i = D Mi + 1. Thus, D Mi +VM. (£+2) +i > Awi+u+i = ^Af, + 1, which is 
(|2.9j) . Finally, we consider the case in which, for some j £ {1, . . . ,v}, the gamblers lose the 
bets T Mi + 1, • • ■ ,T Mi + j - I but win the bet T Mi + j. Then, Xr M .+j = x T M . +j = 1 and 
DM,+j+i = D Mt + 1. Hence, %+v Mi(i+2) +i > £>Af, + 1, which is (f2~H|). □ 

Proof of part 2 of Proposition^^ Fix C > 0, and fix / ^ 5. Since < a < 1, there exists a 
positive integer iV such that 

a- 7V (l-a)(l-«;)- 10 ^/ 2 ) >C- X . 

Define M and <5 as in Lemma I2~%1 Fix e € (0,5). Define (Tk)^ =0 and (Z&)j£l as in Proposition 
O with /i = / and f 2 = f-e. 

By Remark 3 in subsection 12.11 there exist random variables L\ and L2 such that X^ — » Li 
a.s. and Yjt — ► L2 a.s. as fc — > 00, and — Q(f — e) = P(L\ = 1 and L2 = 0). Let A be the 
event that L\ = \ and L2 = 0. Then there is an integer- valued random variable K such that, on 
the event A, we have Xt k > 1 — 1/2 and ly K < 1 — ^. By part 1 of Lemma 12.81 on the event 
A, we have Tk > M{L + 2) and thus X > M. It also follows from part 1 of Lemma 12.81 that if 
Xtj = 1 for j < M, then Yr } = 1, and therefore L2 = 1. Consequently, on the event ^4, we can 
see from the definitions of (Bi)^L and (-Dj)°^ that B>m = Dm and thus, using part 2 of Lemma 
EH1 Bjc > B M = D M > N. 

Since (Zfc)j£L is a nonnegative supermartingale, it follows from the Martingale Convergence 
Theorem (see Corollary 2.11 in chapter 4 of [0]) that there exists a random variable Z such that 
Z^, — > Z a.s. and E[Z] < E[Zq]. On the event A, if j > K then Tj = T# and thus Zj = Zk = Z. 
Hence, using ([2.2 j) . 

Z1 A = Za-U = oT Bk N k {1 - w)- log{XT K- Y T K h A 
> a~ N (l - a)(l - w)" los ^ 2 h A > C^U. 

It follows that E[Z] > C- 1 P(A). Thus, Q(f) - Q{f - e) = P{A) < CE[Z] < CE[Z ] = 
C(l — w) _loge , as claimed. 
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2.4 Proof of part 3 of Proposition 12 . ll 

Let D 1 = S n [0, 1] and D 2 = S n [1 — £, 1]. Define a sequence of stopping times (Tfe)^_ by ro = 
and r fc+ i = inf{n > r fc : X n G [0, £| U [1 - £, 1]} for all k > 0. Then define 

D fc = {/ : P(X Tj = 1 - I for some j < A:|X = /) > 0}. 

Let DjJ = £> fe n [0,£] and D 2 = D k n [1 - Note that D 1 = U£L ^fc and 1)2 = Ufclo D fc- We 
have Dl = and £> 2 _ {x _ For /. > 1; 

^ = {/ G [0,<| : P(X T1 G £> fc _i|X = /) > 0} U D\_ x 
D 2 k = {f€[l- £, 1} : P(X T1 G £> fc _i|X = /) > 0} U D 2 _ x . 

Suppose X = f. If / G {£,1 — 1), then s(f) = £ for all k < t\. Therefore X T1 = f + n£ for 
some n G Z. If instead / G [0,£], then s(/) = /, in which case either Xi = X TX = or X\ = 2f. 
If Xt = 2f, then X T1 = 2/ + n£ for some n G Z, where n = if 2/ G [0, Z] U [1 - £, 1]. Likewise, 
suppose / G [1 -£, £}. Then s(f) = 1 - /, so either X x = X Tl = 1 or Xi = 2f- 1. If X x = 2/ - 1, 
then X n (/) = 2/ - 1 + n£ for some n G Z, where n = if 2/ - 1 G [0,^] U [1 - 1, 1]. 

We claim that if / G I? 1 U -D 2 , then there exist integers a, 6, and c such that / = 2~ c (a + 
Furthermore, we claim that if / 7^ 1 — £, then we can choose a, 6, and c such that c > 1, a > 1, 
a or 6 is odd, and a > 2 if / G D 2 . We will prove these claims by induction on k. Note that 
Dq = {1 — £}, so for / G Dq we can take a = 1, b = —1, and c = 0. Now, suppose our claims 
hold when / G Dj~-i, where k > 1. To show that our claims hold when / G .Dfc, we consider two 
cases. 

First, suppose / G D\ \ D^-i- Then P(X T1 = g\Xo = /) > for some g G Dk-i- Since 

^ S, we must have 2/ + n£ = g, or equivalently / = (g — n£)/2, for some n G Z and 5 G -Dfc-i- 
If g = 1 - 4 then / = (1 - (n + 1)0/2, so / = 2~ c (a + M), where a = 1, b = -(n + 1), and 
c = 1. 11 g j£ 1 — £, then 5 = 2 _c (a + &•£), where c > 1, a > 1, and a or 6 is odd. Then 
/ = 2- {c+l \a + b£- 2 c n£) = 2- {c+l \a + (b - 2 c n)£). Note that c + 1 > 1, a > 1, and b - 2 c n is 
odd if 6 is odd, so a or 6 — 2 c n is odd. 

Next, suppose / G D\ \Dk-i- Then P(X T1 = g\X$ = f) > for some g G Dk-i- Since I ^ S, 
we have 2f — 1 + n£ = g, or equivalently / = (1 + 5 — n£)/2, for some n G Z and g G D^-i- If 
5 = 1 — £, then / = (2 — (n + l)£)/2. If ra + 1 were even, then / = 1 — for some positive 
integer m; since L> 2 C [1 - i, 1], we would have / G {1 - £, 1}, which is a contradiction because 

1 </ D 2 . and 1 — £ G P>k-\- Therefore, n + 1 is odd, so / = 2~ c (a + b£), where c = 1, a = 2, and b 
is odd. If instead g ^ 1 — I, then g = 2~ c (a + b£), where c > 1, a > 1, and a or 6 is odd. Then 
/ = 2"( C+1 )(2 C + a + W - 2 c n£) = 2-( c+1 )[(2 c + a) + (b - 2 c n)£]. Note that c + 1 > 1, 2 C + a > 2, 
and either 2 C + a or 6 — 2 c n is odd because 2 C and 2 c n are even and either a or 6 is odd. It now 
follows by induction that our claims hold for all / G D 1 U D 2 . 

Since £ < 1/2, we can choose a positive integer m such that 1 — m£ G (£,2£]. We can then 
choose positive integers d and n such that 2~ d {l — ml) < 1 — 2£ and 2 _rf (l — ^) + n£G (1 — 2£, 1 — £). 
Let / = 2- d (l-m£) + n£. Note that / G {£,! — £). Also, / - £ = 2~ d {l - m£) + (n - 1)1 Suppose 
a gambler who starts with a fortune of /— •£ loses the first n — 1 bets, then wins the next d+m — 1. 
After the n — 1 losses, the gambler's fortune will be 2 _rf (l — ml). Then after d wins, the fortune 
will be 1 — ml. After m — 1 additional wins, the gambler's fortune will be 1 — £. Consequently, 

P(X n+m+d - 2 = l-£\X o = f-£)>0, 
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which means / — £ £ S. We now show by contradiction that / + £ ^ S, which will complete the 
proof. Suppose / + £ G S. Since / + 1 > 1 — £, there exist integers a, b, and c such that a > 2, 
c > 1, a or 6 is odd, and / + I = 2" c (a + W). We also have f + £ = 2~ d (l + (2 d (n + 1) - m)£). 
Therefore, 2 d (a + M) = 2 C [1 + (2 d (n + 1) - m)4 and so 2 d a - 2 C = [2 c (2 d (n + 1) - m) - 2 d b}£. 
Since £ is irrational, we must have 2 d a - 2 C = 2 c (2 d (n + 1) - m) - 2 d b = 0. Thus, 2 d a = 2 C , and 
since a > 2, it follows that a is even and c> d. Therefore, b is odd and b = 2 c ~ d (2 d (n + 1) — m), 
which is a contradiction. 

2.5 Obtaining Theorem 11.11 from Proposition 12. ll 

Suppose £ is irrational. By part 3 of Proposition l2.11 there exists /o G (£, l—£) such that fo—££S 
and fo + £ $l S. Let / = /o — e, where < e < £ and e is small enough that f £ (£,1 — £). We 
will show that for sufficiently small e, we have 

wQ(f + £-e) + (l- w)Q(f -£ + e)> Q(f), (2.11) 

which implies Theorem II . II because s(f) = £. Note that 

wQ(f + £-e) + (1- w)QU -£ + e) = wQ(f + £-2e) + {\- w)Q(f - £). (2.12) 
Since / i— > Q(f) is nondecreasing, we have 

QU) = wQ(f + £) + (!- w)Q(f -£)< wQ(f + £) + (1 - w)Q(f -£-e). (2.13) 

Since fo — £ E S, it follows from part 1 of Proposition 12. II that there exists a constant C > such 
that 

Q(f -£)-Q(f -£-e)>C(l-w)- l °^. (2.14) 

Let Co = C(l — w). Since /o + £ ^ <S, part 2 of Proposition 12.11 implies that for sufficiently small 
e, we have 

Q(/o + £)- Q(/o + * - 2e) < 0,(1 - ^)" los2e = C(l - W )- loge . (2.15) 
Let B = C(l - w)- lo s e . Equations (t2~T2|) - (pT5ll imply 

wQ(/ + £ - e) + (1 - w)Q(/ - ^ + e) - Q(/) > -wB + (1 - M )B = (1 - 2w)S > 

for sufficiently small e, which gives (|2.11jl . 
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